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Abstract. We apply trajectory mapping to an eight-year intercomparison of 
ozone observations from HALOE (V 19) and SAGE II (V6.00) for the months 
March, May, June, September, October, and December from the period December 
1991 - October 1999. Our results, which represent the most extensive such inter- 
comparison of these two data sets to date, suggest a root-mean-square difference 
between the two data sets of greater than 15% below 22 km and of 4 - 12% 
throughout most of the rest of the stratosphere. In addition, we find a bias with 
HALOE ozone low relative to SAGE II by 5 - 20% below 22 km between 40°S 
and 40°N. Biases throughout most of the rest of the stratosphere are nearly non- 
existent. Finally, our analysis suggests almost no drift in the bias between the 
data sets is observed over the period of study. In the course of our study, we also 
determine that the employment of the Wang-Cunnold criteria is still recom- 
mended with the V6.00 SAGE II ozone data. Results with the new versions of the 
data set§ show significant improvement over previous versions, particularly in the 
elimination of mid-stratospheric biases and the elimination of the previously ob- 
served drifts in the biases between the data sets in the lower stratosphere. Since 
HALOE V19 and VI 8 ozone are very similar, these changes can likely be attrib- 
uted to improvements in the SAGE II retrieval. 
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1. Introduction 

An important problem in stratospheric research remains the nature of the mecha- 
nism responsible for the observed negative trends in midlatitude column ozone [Stolarski 
er al, 1991; Hollandsworth, et al , 1995], Ozone photochemistry is highly dependent 
upon altitude, with NO x , HO x , and C10 x all serving as dominant loss mechanisms at dif- 
ferent altitudes [e.g., Jackman, et al., 1986], As a consequence, understanding the cause 
of observed negative trends in the column requires knowledge of the changing shape of 
the ozone profile. While the Total Ozone Mapping Spectrometer (TOMS) instrument has 
provided a long and reliable global data record of the total column amount of ozone, it is 
unable to comment on the distribution of ozone within the column. To answer the ques- 
tion of the midlatitude trends in the vertical profile of ozone, data from other instruments 
are required. 

Two such instruments that supply high-resolution vertical profiles of ozone over a 
wide range of latitudes are the Halogen Occultation Experiment (HALOE) [Russell et al., 
1993] and the Stratospheric Aerosol and Gas Experiment (SAGE) II [Mauldin et al., 
1985; Chu et al, 1989], Both instruments use the solar occultation technique to derive 
their measurements of ozone and other atmospheric constituents. (Further details about 
these instruments can be found below.) To develop confidence in these two data records 
and to determine their value to diagnosing the midlatitude trends, we would like to evalu- 
ate how well they agree with another, and to what extent that agreement changes with 
time. 

Recently both the SAGE II and HALOE instrument teams released new versions 
of their data sets. While HALOE VI 9 ozone is very similar to the VI 8 data, the SAGE II 
V6.00 ozone represents a major revision to the SAGE II retrieval process. Evaluation of 



the differences between version 6.00 of the SAGE II data sets and a variety of correlative 
measurements is the subject of an upcoming special section of the Journal of Geophxsi - 
cal Research. The evaluation of previous versions of these data have been the subject of 
numerous previous publications including the SPARC Report [1998], part of which ad- 
dresses the issue of the consistency of the SAGE II (V5.96) and HALOE (VI 8) ozone 
data records. 

Due to the measurement technique that both of these two instruments employ and 
the orbital parameters of the satellites on which they ride, they do not often make their 
observations near the same geographic locations at the same time. Traditional validations 
efforts have often been frustrated, particularly in the tropics, where infrequent observa- 
tions by both instruments lead to statistically insignificant results. As a result, the studies 
presented in the SPARC report struggle to produce statistically significant results when 
employing traditional coincident observations and zonal means to make comparison be- 
tween the HALOE and SAGE II observations. 

In the remainder of the paper, we discuss the use of and employ trajectory map- 
ping (TM) as described by Morris et al. (1995) to compare the two new versions 
(HALOE VI 9 and SAGE II V6.00) to one another as well as the previous versions 
(HALOE VI 8 and SAGE II V5.93) to one another. Our study includes the months of 
March, May, June, September, October, and December for the eight-year period of De- 
cember 1991 - October 1999, i.e., 6 months in each of 8 years for a total of 48 months of 
data. TM produces robust results for the comparison of ozone observations between 
HALOE and SAGE II over a range of latitudes from ~60°S to ~60°N. We compare these 
two data sets using three statistical measures: the root-mean-square (RMS) difference, 
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the bias (or offset) between the HALOE and SAGE II observations, and the drift in the 
bias as a function of time. Particularly important to the negative midlatitude trend in the 
vertical ozone profile is the drift in the bias statistic. While offsets between the instru- 
ments may be troubling, if the instruments exhibit no drift relative to one another, then 
the trend calculations performed using both data sets remain valid. 

We show in this paper that the latest versions of ozone observations from these 
two instruments exhibit little if any statistically significant drift with respect to one an- 
other over the 8-year record analyzed here. With the difficulties experienced by the 
SAGE II instrument in the late Summer and Fall of 2000 after 16 years of service, our 
results provide hope that we can extend and enhance the long and unique SAGE II ozone 
profile data record by using HALOE, which continues to function aboard the UARS sat- 
ellite. 

In addition to examining the latest versions of these data sets, we present results 
from a comparison of the last publicly available versions of each data set (HALOE VI 8 
and SAGE II V5.93) to establish a baseline by which to judge present versions of the re- 
trieval algorithms and to compare with earlier published comparisons of the two data sets. 
We note that the latest versions of the data sets have resulted in a significant reduction in 
the magnitude of the drift between HALOE and SAGE II. particularly in the lower tropi- 
cal stratosphere, and a reduction of the earlier observed biases between the two data sets 
in the mid and upper stratosphere in the tropics and northern midlatitudes. Since HALOE 
VI 8 and V19 ozone profile data products are nearly identical, these results suggest that 
significant improvements have been realized in the SAGE V6.00 product over the V5.93 
product. 
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1.1. HALOE 

HALOE rides on the Upper Atmosphere Research Satellite (UARS) which was 
deployed September 14, 1991 from the Space Shuttle Discovery. UARS was launched 
into an orbital plane inclined 57° to the Equator and circles the Earth at an altitude of 585 
km with an orbital period of about 96 minutes. The orbit precesses at a rate of 5° per day. 
Ten times per year, the satellite performs a yaw maneuver, which rotates the platform 
180° relative to its orbital velocity vector. These orbital parameters permit HALOE to 
make its observations from roughly 30°S to 70°N or 30°N to 70°S in each UARS 
“month,” although the precise latitudes covered vary from month to month. For further 
information on the UARS platform, see Reber et al. [1993]. 

HALOE uses the solar occultation technique to make constituent measurements 
twice per orbit: once at sunrise and once at sunset. The instrument makes measurements 
with a vertical resolution of ~2 km, a horizontal field of view of 5 km (measured at the 
surface) perpendicular to the line-of-sight, and a limb path length of 300 km [Russell et 
al . , 1993], 

Since UARS completes approximately 15 orbits each day, HALOE returns 30 
profiles daily: 15 at sunrise, 15 at sunset. This measurement strategy provides good lon- 
gitudinal coverage on two latitude circles each day, one corresponding to the sunrise lo- 
cations. the other corresponding to the sunset locations. Latitude coverage of HALOE 
varies continuously over each UARS month. 

To derive constituent profiles, HALOE observes absorption bands in the infrared 
part ot the spectrum between 2.45 and 10.04 Jim. with 9.6 jam being used for ozone re- 
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trievals [Russell et ul . , 1993], By measuring the absorption lines in the spectrum of well- 
known background source, the sun, HALOE measurements are practically self- 
calibrating and highly precise. In order to derive mixing ratios, a temperature versus 
pressure profile is retrieved from HALOE data over the 5 to 85 km range using the CO: 
2.8 (im band. Observations are tied to the National Center for Environmental Prediction 
(NCEP), temperature, pressure, and altitude data for altitudes below 35 km [Russell, et 
al., 1993], The presence of aerosols from the eruption of Mt. Pinatubo (from launch 
through 1993) complicates the retrieval procedure, especially below 30 km. 

Due to problems with the satellite’s solar array, limited data were retrieved during 
June and early July 1992. Outside of this period, the satellite has performed admirably, 
and HALOE has operated nearly continuously since it was turned on about 4 weeks after 
launch. For further information, see Russell et al. [1993]. 

1.2. SAGE II 

The Stratospheric Aerosol and Gas Experiment II (SAGE II) was launched in Oc- 
tober 1984 aboard the Earth Radiation Budget Satellite (ERBS). Like HALOE, SAGE II 
is a solar occultation instrument. SAGE II, however, makes its ozone observations in the 
visible portion of the spectrum, primarily using data from the center of the Chappuis ab- 
sorption band measured by the instrument’s 0.6 pm channel. ERBS orbits the Earth 
along a circular path at a distance of 610 km above the surface of the Earth with an incli- 
nation of 56°. Over the course of approximately one month, SAGE II records observa- 
tions at latitudes between 70°S and 70°N, although the precise coverage varies from 
month to month. Like HALOE, SAGE II observations are made twice per orbit: once at 
sunrise and once at sunset. The SAGE II observations, therefore, are also limited to two 
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narrow latitude bands each day. Further details on the SAGE II instrument can be found 
in Mauldin et til. [1985] and on the original SAGE II retrieval algorithm in Chu et til. 
[1989], The SAGE II instrument has been collecting data nearly continuously since the 
launch of the ERBS satellite. 

Modeling of the original retrieval algorithm by Chu et al. [1989] suggests that be- 
low 20 km, aerosol contributes more than half of the signal at 0.6 |im. As a result, the 
presence of aerosols from the eruption of Mt. Pinatubo made use of the SAGE II ozone 
data below 25 km nearly impossible for an extended period after the eruption. A study 
by Wang and Cunnold yielded Table 2.2 in the SPARC Report [1998] which delineates 
periods and altitude ranges for which use of the SAGE II ozone data are not recom- 
mended. A recent failure of the instrument in summer of 2000 temporarily interrupted 
the data record after some 16 years of nearly flawless operations. 

1.3. Trajectory Mapping 

We use TM to compare HALOE and SAGE II ozone. Since both instruments are 
solar occultation instruments, the two data sets are sparse when compared to data sets 
gathered from emission instruments such as the Microwave Limb Sounder (MLS) 
[Barath et al ., 1993] or the Cryogenic Limb Array Etalon Spectrometer (CLAES) [Roche 
et al, 1993]. The nature of the occultation instrument data sets makes comparisons using 
traditional techniques difficult. For example, in the study of Morris et al. [2000]. only 
-10% of the 1500 measurements made by HALOE and SAGE II in a two-month-long 
period in 1995 could be correlated using a traditional coincidence approach. TM substan- 
tially increases the number of coincidences between the two satellite instruments and ex- 
pands the latitude range of coincidences beyond traditional techniques. Furthermore, by 
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taking into account dynamical variability, the trajectory technique often improves the sta- 
tistics of coincident comparisons relative to more traditional approaches [Morris et al ., 
2000 ], 

TM has been described in detail by Morris et al. [1995] and thoroughly evaluated 
in a recent study by Morris et al. [2000], In brief, TM takes advantage of quasi-conserved 
quantities following air parcel motion, namely the mixing ratio and potential temperature. 
The first use of trajectory calculations to map satellite observations appeared in the map- 
ping of the Halogen Occultation Experiment (HALOE) data set by Pierce et al. [1994], 

To create a synoptic trajectory map from satellite data, we initialize an air parcel 
in our trajectory model [Schoeberl and Sparling, 1994] at the time and location of each 
satellite observation. The model then isentropically advects these air parcels forward or 
backward in time to the time at which we desire an output synoptic map. In general, we 
employ a combination of forward and backward trajectory calculations as recommended 
by Morris et al. [2000]. By including both forward and backward trajectory calculations, 
we minimize the impact of neglected diabatic processes and greatly enhance the density 
of coverage in our trajectory maps, and hence, the chances that we will be able to com- 
pare measurements from the two sparse satellite data sets. Furthermore, by accounting 
for dynamical changes in the atmosphere between observation times, TM provides better 
representations of the measured constituent fields than other schemes (e.g., asynoptic 
maps or fourier maps) [Morris et al., 1995], 

To compare ozone data from the SAGE II and HALOE instruments, we first cre- 
ate a series of synoptic trajectory maps from one of the data sets. We then sample the 
synoptic maps created from the first instrument at the times and locations of the observa- 
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tions ot the second instrument. We consider those trajectory-mapped measurements ap- 
pearing within a specified distance ot the observations of the second instrument to be co- 
incident. A maximum time difference between the observations is also specified to limit 
the duration of trajectory calculations. Details on the specific parameters chosen for our 
study are provided below. 

Ideally, we would create a trajectory map at the time of each new observation by 
the second instrument. In so doing, we account for movement of air parcels in which the 
first instrument made its observations. Because of the number of observations included 
in our 8-year study period, however, this practice is impractical. Instead, we use data 
from both instruments to produce trajectory maps twice per day, once at midnight and 
once at noon Universal time (UT). All new observations from the one instrument appear- 
ing in a given trajectory map are then compared with the surrounding, trajectory-mapped 
measurements from the other instrument. The “new” observations are thus advected for 
less than 12 hours by the model, a timescale short enough that it should have little to no 
negative impact on our statistical comparisons of the data from the two instruments 
[Morris et al., 1995]. 

2. Methodology 

In this section we detail the specific parameters of the trajectory technique that we 
employ to compare HALOE V19 to SAGE II V6.00 ozone data and HALOE VI 8 to 
SAGE II V5.93. Our study examines data from the months of March, May, June, Sep- 
tember. October, and December tor the eight-year period of December 1991 — October 
1999. 
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In order to yield global coverage in our trajectory maps of HALOE and SAGE II 
data, we use isentropic trajectories of up to 14 days duration as calculated with balanced 
winds computed from meteorological data provided by the National Centers for Envi- 
ronmental Prediction (NCEP) [Newman et al., 1988; Randel, 1987]. Using calculations 
of up to 14 days duration enables TM to produce coincidences between the two instru- 
ments at nearly all latitudes, a result unattainable by traditional approaches (e.g.. SPARC, 
1998). For each month included in the study, we initialize and advect air parcels corre- 
sponding to all observations made during the period from two weeks prior to the begin- 
ning of the month through two weeks after the end of the month. Each observation taken 
in the month of interest can be correlated with observations from the other instrument 
made within a four-week period centered on the time of the observation. By using a com- 
bination of forward and backward trajectory calculations, we tend to reduce the bias that 
can be introduced when using isentropic trajectory calculations to validate a trace gas 
with a vertical gradient such as ozone [Morris et al, 2000]. While the isentropic ap- 
proximation degrades with the length of the trajectory calculations, numerous studies 
have cited a period of 7 - 10 days as a reasonable upper limit on isentropic trajectory 
analyses [Schoeberl and Sparling, 1994; Sutton et al., 1994; Morris et al., 1995]. Morris 
et al. [2000] show that by using a combination of forward and backward trajectories to 
construct trajectory maps, even calculations of 10 - 14 days can be employed in valida- 
tion efforts with small to negligible impact on the bias statistic (less than 2 % for the water 
vapor study presented in that paper). 

We run isentropic trajectories at 8 vertical levels spanning an altitude range from 
-15 to -40 km (precisely, the trajectories were run on the 400, 450. 500, 550, 600. 800. 
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1000, and 1200 K potential temperature surfaces). Again to minimize errors introduced 
in TM validation efforts, we employ a coincidence criterion of 400 km as recommended 
by the results of previous studies [Morris el al. 2000: Rex et al , 1998] and as is consis- 
tent with the limb path length of the occultation instruments. 

We initialize each HALOE observation in a tight cluster of 5 parcels (forming a 
cross with parcel separation of 40 km) and advect these particles forward and backward 
in time to the location of the SAGE El observations. We repeat the process by initializing 
each SAGE II observation as a tight cluster of 5 parcels and advect the SAGE II air par- 
cels forward and backward in time to the location of the HALOE observations. The re- 
sults presented in this paper represent a statistical combination of those produced with 
each of these two scenarios. Differences between the results computed from these two 
scenarios provide an estimate of the uncertainty in statistics. 

Statistics are computed using trajectories of 1.5-, 3-, 5-, 7-, 10-, and 14-days dura- 
tion. The results presented in this paper also are derived with a statistically weighted 
combination of the results calculated from each of these different duration TM runs. TM 
coincidences are given a statistical weight equal to the inverse of the trajectory duration. 
For example, 1 ,5-day trajectory correlations are given twice the weight in computing the 
RMS statistic as are 3-day trajectories and over 9 times the weight of a correlation found 
with a 14-day trajectory. In this way, we heavily weight our statistics toward the shortest 
available TM coincidences in each latitude band and rely on the longest trajectories only 
in those latitude bands where no shorter trajectories produce coincidences. 

Figure 1 shows the mean duration of all trajectories that result in coincidences as 
a function of latitude and as computed for trajectories on the 800 K potential temperature 



surtace. (We note that analysis of this same quantity on other potential temperature sur- 
faces shows little dilference with the 800 K surface, though trajectories in the lower 
tropical stratosphere tend to run slightly longer (~1 day) than those at 800 K.) Error bars 
in the figure represent one standard deviation difference from the mean as calculated 
from the data within each latitude bin. Where no error bars appear, the error bars are 
smaller than the size of the plot symbol. The boundaries of the latitude bins appear in 
Table 1 and are the same as those used to analyze our three statistics (RMS, bias, and 
drift) outlined below. With the exception of the tropics (24°S to 24°N), mean trajectory 
calculations are on the order of 5 — 7 days. Even within the tropics (except from 8°S to 
8°N) the trajectories are of less than 7-10 days duration, a previously acknowledged ac- 
ceptable limit for isentropic trajectory calculations. Only in the latitude bin closest to the 
equator do our trajectory calculations frequently exceed the 7 - 10 day duration. Results 
from Morris et al. [2000], however, suggest that calculations of up to 14 days can be use- 
ful statistically in evaluating the agreement between two data sets. Figure 1 therefore 
suggests that, on average, the trajectory data employed to produce the figures and conclu- 
sions outlined below should not be discounted for having been produced with unreasona- 
bly long trajectory calculations. 

We employ three statistical tests in our evaluation of the agreement between the 
HALOE and SAGE II ozone data records: the root-mean-square (RMS) difference, the 
bias (or offset) between the instruments, and the drift in time of the bias. In computing 
each statistic, we first bin the data both horizontally and vertically. Horizontally, we bin 
the data every latitude between 68°S and 32°S and between 32°N and 70°N and use 
somewhat larger bins in the tropics between 32°S and 32"N. The precise boundaries of 
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the latitude bins are provided in Table 1 and are selected in attempt to more evenly dis- 
tribute the coincident observations between the latitude bins than would be produced by 
equally spaced latitude bins. Vertically the data are in -2.5 km bins (i.e.. the potential 
temperature surfaces listed above). 

The RMS difference between the HALOE and SAGE II data records is expressed 
as a percentage of the SAGE II observations and is computed as follows: 

IS, 



where N is the total number of coincidences in each bin. Hi is the HALOE data, 5/ is the 
SAGE II data, and vv, is the weight given due to the trajectory length (the inverse of the 
trajectory duration in days that results in each coincidence: 1/1.5, 1/3, 1/5, etc.). We 
compute the RMS statistic defined above in two ways. First, we define H, as the mean of 
the trajectory mapped HALOE observations that satisfy our coincidence criteria around 
the i' h SAGE 13 observation ( S ,). We then recompute the RMS statistic defining S, as the 
mean of the trajectory mapped SAGE II observations that satisfy our coincidence criteria 
around the i ,h HALOE observation (//,). The RMS statistic that appears in the figures in 
this paper is the statistically weighted mean of the RMS statistic as computed both ways. 
In the figures shown below, we have converted potential temperature to pressure altitude 
by using the mean pressure of the air parcels advected into each bin. 

We compute the bias (A) of HALOE relative to SAGE II expressed as a percent- 
age of SAGE II observations through the relationship 


RMS(%) = 100x^ 


£( 



I(h;(//,-S,)/5.) 

A(%) = 1 00 x 1=1 v 

t=l 

where the variables are defined as for the RMS statistic above. Although we compute the 
bias relative to the SAGE II data, we in no way imply that the HALOE data is more or 
less accurate than the SAGE II data. We choose this formulation of the bias to be consis- 
tent with previous studies (e.g. SPARC Report , 1998) in which all other ozone data sets 
are compared to the SAGE II data. As is the case with the RMS statistic, the HALOE 
and SAGE II data are binned by latitude and altitude before computation of A(%). 

Finally, we compute the drift in the bias statistic using a simple, least-squares 
weighted linear regression model of the bias statistic with time. For each latitude/altitude 
bin, we create a time series from the bias data. We then fit a straight line of the form 

A,(%) = At + B 

where A, is the modeled bias at time t and A represents the drift in the bias and is com- 
puted using the formulation 



where A, is the bias (as defined above) of H , relative to 5, at time t,. 
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3. Results and Analysis 

Figure 2 shows the zonal mean, RMS differences between SAGE II V6.00 and 
HALOE V19 ozone measurements combined for the entire 8-year study period. RMS 
differences between HALOE and SAGE II ozone observations below 22 km exceed 15%. 
Above 22 km, the RMS differences are roughly 4-12% from 60°S to 60°N latitude, with 
higher values poleward of 60° and a region of slightly higher values around 15°N latitude 

and 31 km altitude. The RAIS differences between HALOE V19 and SAGE II V6.00 

¥ 

show only minor changes from those found between HALOE VI 8 and SAGE El V5.93 
(not shown, but which reveals a slightly higher, on the order of 1% or less, RMS statistic 
above 22 km from 60°S to 60°N). 

Previous validation efforts have shown results generally in agreement with our 
findings in Figure 2, though no previous analyses have been carried out over as extensive 
a range of observations as presented in this work. A previous trajectory analysis of se- 
lected SAGE II ozone profiles in the northern midlatitudes (45° - 50°N) during 1993 
showed 10 - 20% differences above -22 km [Lu et ai, 2000] between new observations 
and those advected by their dynamical model. These differences are somewhat larger on 
average than those that we find between HALOE and SAGE II at the same latitudes. 

Figure 3a shows the bias of HALOE V19 ozone data as compared to SAGE II 
V6.00. The regions marked by dash-dot lines and containing vertical stripes of stars (*) 
represent regions of statistically insignificant differences: in these regions the bias is 
smaller than the difference between the biases computed with the HALOE to SAGE II 
trajectory maps and those computed with the SAGE II to HALOE trajectory maps, as de- 
scribed earlier. As can be seen in the figure, the trajectory results indicate a bias of 5 - 
20% with HALOE lower than SAGE II below 22 km in the tropics and subtropics, and 
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lower midlatitudes, between 40”S and 40 J N latitude. A localized region with HALOE 
biased 4-8% low compared to SAGE II also appears at 60°S and 25 km. Throughout 
most of the remainder of the stratosphere, little to no bias is observed between the data 
sets from 60°S to 60°N. These results differ from those found in the comparison of 
HALOE VI 8 with SAGE II V5.93 shown in Figure 3b. We note that with the new ver- 
sions of these data used in the production of Figure 3a, the regions in Figure 3b in which 
HALOE appears biased high compared to SAGE II (in the mid to upper stratosphere: 0° 
— 30°N, 26 - 32 km; 60°N above 27 km; and 60°S above 32 km) have entirely disap- 
peared. 

We also note that between Figure 3b and Figure 3a, we see large decreases in the 
bias at latitudes between 40° and 60° below 20 km in both hemispheres. This decrease in 
the bias suggests some improvement has been made in the lower stratosphere at these 
latitudes by the latest SAGE II retrieval. Since changes between HALOE VI 8 and V19 
are relatively minor, most of the observable differences between Figures 3b and 3a can be 
attributed to changes in the SAGE II retrieval algorithm. (In fact, we have examined 
HALOE VI 9 versus SAGE V5.93 maps and find little difference from the maps of 
HALOE VI 8 versus SAGE V5.93 shown in this paper.) In the tropics and subtropics be- 
tween 30°S and 30°N below 24 km, we observe little change in the bias statistic. 

Numerous previous validation studies have found biases similar to those that ap- 
pear in Figure 3. Cunnold et al. [2000] found differences of more than 10% between 
SAGE II (V5.96) and HALOE ozone observations in the lower stratosphere (below 20 
km) with HALOE low compared to SAGE II and with the largest differences occurring in 
the tropics. Such results seem consistent with Figure 3, where we also find the largest 
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differences, well exceeding 10% in the tropical lower stratosphere, with HALOE again 
low compared to SAGE II. Comparisons of SAGE II observations with ozonesondes 
have repeatedly shown SAGE II observations exceeding sonde observations in the lower 
stratosphere by 5 - 20% [SPARC, 1998; Veiga et al. , 1995], Comparisons of the SAGE 
II ozone observations with Iidar show SAGE II high by 4.5 - 9.5% +/- 4% at 20 km 
[5f*Ai?C, 1998] and by around 2.5% in a 3-year study comparing SAGE II ozone to the 
Iidar in Lauder, New Zealand [Brinksma, et al, 2000]. Results shown in Figure 3a show 
1 to 5% differences around the latitude of Lauder (45°S), in rough agreement with the 
Lauder Iidar. Comparisons with Umkehr data show SAGE II high by 10% below layer 3 
(-15 km) [SPA/?C, 1998] and SAGE II low compared to Umkehr in layers 5 and 6 (-23 - 
-32 km) by 3 - 8% [Newchurch et al., 1995]. At 18 km we find SAGE H higher than 
HALOE by similar amounts. Between 23 and 32 km, we generally find HALOE VI 8 
higher than SAGE II V5.93 by 0 — 4% (Figure 3b), but little to no bias is evident between 
HALOE V19 and SAGE II V6.00 at these altitudes (Figure 3a). 

The SPARC Report [1998] also compares SAGE II V5.96 with HALOE V18 and 
finds general agreement of the two ozone data sets to within 5% between 25 and 50 km. 
Below 22 km, however, differences up to and exceeding 20% are reported. A study by 
Atkinson and Hollandsworth produced Figure 2.32 of the SPARC Report [1998], which 
shows a comparison of HALOE and SAGE II ozone observations using coordinate map- 
ping (CM), a dynamical approach to data validation developed by Schoeberl and Lait 
[1993]. Their figure can be most directly compared with our Figure 3. The CM results 
reveal biases in the lower stratosphere (below the 500 K potential temperature surface or 
-22 km) of HALOE more than 10% lower than SAGE II across most latitudes, in agree- 



ment with our results. CM also finds a region of slight bias with HALOE high in the 
tropical middle stratosphere. This region of high HALOE bias extends to higher altitudes 
through the northern midlatitudes. Again, we observe a similar feature in the TM results 
of Figure 3. One feature that seems to have been eliminated in the current versions (Fig- 
ure 3a) from the previous versions (e.g., Figure 3b) of the algorithms is an area of bias of 
HALOE high relative to SAGE II at 60°S in the middle and upper stratosphere. This re- 
gion of bias appears in both the CM data and in the TM data for the HALOE VI 8 to 
SAGE II V5.93 comparison (Figure 3b) but does not appear in the HALOE V19 to SAGE 
II V6.00 comparison (Figure 3a). 

The observed pattern of SAGE II ozone observations high relative to most other 
ozone observations in the lower stratosphere has been a subject of prior investigation. 
Previous versions of the SAGE II retrieval algorithm contain problems related to aero- 
sols, as identified by Steele and Turco [1997] and Cunnold, et al. [1996b]. In particular, 
Steele and Turco [1997] determine that the SAGE IT retrieval algorithm contains errors 
that cause retrieved ozone values to be erroneously high (by as much as 15%) in the pres- 
ence of substantial volcanic aerosol. The eruption of Mount Pinatubo in 1991 created 
such conditions that affected the lower stratosphere through 1994. Just correcting for this 
aerosol retrieval problem, however, will not alone eliminate the observed differences be- 
tween SAGE II and other instruments at low altitudes. As we observe in Figure 3a, even 
the latest version of the SAGE II retrieval, for which substantial changes have been made 
in light of the discoveries of problems with previous versions of the retrieval algorithm, 
reveals a lower stratospheric bias. Although not shown in this paper, we compute statis- 
tics for the period after the subsidence of the Pinatubo aerosols ( 1995 - 1999 ) separately 
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to determine the impact ot the aerosols on our results. We find that the pattern and mag- 
nitude ot the bias during the 1995 — 1999 period (not shown) is very similar to that repre- 
sented in Figure 3a for the entire 8-year study period. Under background aerosol 
conditions. Steel and Turco [1997] suggest that the earlier SAGE II retrieval algorithm 
produced ozone values too low by up to 15% in the lower stratosphere. If this error were 
the only one affecting SAGE II ozone, the bias between SAGE II and HALOE would ac- 
tually grow after correcting for it. Furthermore, we employ in our analysis the criteria 
developed by Wang and Cunnold [SPAflC, 1998] to effectively eliminate the influence of 
data contaminated by the presence of the Pinatubo aerosols during the period immedi- 
ately following the eruption. SAGE II observations that would be affected by the re- 
trieval error identified by Steele and Turco [1997] therefore are not included in our 
analysis, yet the bias remains apparent. 

Figure 4a shows the drift between HALOE VI 9 and SAGE II V6.00 ozone obser- 
vations over the period December 1991 through October 1999. We computed the mean 
drift by applying the simple linear trend model discussed earlier to the bias statistic of 
HALOE relative to SAGE II. Figure 5 shows an example of the bias vs. time for a single 
bin of Figure 4a at 600 K from 32° to 36°S. The line represents the best fit to the data as 
computed using the drift formulation above. Similar fits were found for bins at all lati- 
tudes and altitudes in our study to complete the construction of Figures 4a and 4b. In 
Figures 4a and 4b, the regions marked by dash-dot lines and containing vertical stripes of 
stars (*) represent regions of statistically insignificant differences: in these regions the 
drift in bias is smaller than the difference between the drift-in-bias statistic computed 
with the HALOE to SAGE II trajectory maps and that computed with the SAGE II to 
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HALOE trajectory maps. T.M results suggest essentially no drift of HALOE VI9 relative 
to SAGE II V6.00 over the ~ 15 - 40 km altitude range. These results represent a signifi- 
cant improvement relative to those found with the previous versions of these data sets. 

Figure 4b show's the same statistic as determined with TM applied to the HALOE 
V18 and SAGE II V5.93 data sets. With the previous version of these data sets, we ob- 
served drifts of 2 - 5% per year in the lower stratosphere with HALOE increasing rela- 
tive to SAGE II. As this region is one in which HALOE VI 8 observations are observed 
to be lower than SAGE II V5.93, the drift suggests that the observations of the two in- 
struments were drifting together over time. The presence of any drift between the two 
instruments raises cause for some alarm in efforts to evaluate trends in the ozone profile 
shape with SAGE V5.93. While the offsets between the new versions of these data sets 
are still potentially worrisome in and of themselves (Figure 3a), the lack of an observable 
drift between the data are encouraging for the use of these data in trend calculations. 
Looking at Figure 4a in the lower tropical stratosphere, we see a large drift, whereas in 
Figure 4b in the same region, we see little to no drift. This difference suggests an im- 
provement has been made in the SAGE II V6.00 retrieval of ozone in the lower strato- 
sphere. 

The SPARC report [1998] also examines the drift of the HALOE VI 8 ozone data 
set relative to SAGE II V5.96. Findings reported in that study show drifts of less than 
0.5%/year at most latitudes and altitudes with a few exceptions: 1) 55°S where the drifts 
were I %/year; 2) 15°N and 55°S where the drifts were 1.5 to 2%/year; and 3) at 20 km 
where the drifts were 2 - 4%/year. We note that these conclusions were obtained through 
use of much smaller subsets of the data than are employed in the present study. Further- 
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more, with so tew coincidences, the report could not identify any useful results in the 
tropics. Nevertheless, in those regions on which the SPARC report did comment, we find 
general agreement with our results of Figure 4b. Comparing the SPARC results with Fig- 
ure 4a, however, we find few remaining regions where drifts of larger than 1 %/year exist. 

We examine the impact of the criteria of Wang and Cunnold [5PA/?C, 1998] on 
our results using the latest versions of the two data sets. While we find that not employ- 
ing the Wang and Cunnold criteria has only small impact on the RMS and bias statistics, 
we note that the drift statistic in the lower stratosphere becomes less coherent, and re- 
gions of 2 - 4%/year drift appear in the tropical lower stratosphere (not shown). We 
therefore recommend continued use of the Wang and Cunnold criteria as outlined in the 
SPARC Report [1998] for trend calculations. 

We also investigate the effect of the choice of meteorological wind field on our 
results. As shown in Morris et al. [1995], the choice of wind fields has the largest poten- 
tial impact on the results of the trajectory calculations. We ran trajectories for the same 
set of months (March, May, June, September, October, and December) for the 7 year pe- 
riod from December 1991 - December 1997 using wind fields from the National Centers 
for Environmental Prediction (NCEP) and the United Kingdom Meteorological Offices 
(UKMO). In this study we use HALOE VI 8 and SAGE II V5.93 data. With minor ex- 
ceptions the results achieved with the UKMO meteorological data (not shown) were the 
same as those achieved with the NCEP data. The good agreement between the results 
achieved with the two different wind fields enhances our confidence in our methodology 
and in the conclusions cited above. While we did not repeat this study with the latest ver- 
sions of the data or through the extended study period (through October 1999). we do not 
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believe our conclusions would change. The meteorological wind field choice does not 
appear to have a substantial impact on the results of this study. 

4. Summary and Conclusions 

In conclusion, we have presented the most complete and wide-ranging compari- 
son of the HALOE and SAGE II ozone profile data sets to date. Using TM, we are able 
to comment on the RMS differences, the biases, and the drift in those biases with time 
between these two important data sets over an 8-year period from 1991 - 1999. We find 
typical RMS differences between HALOE V19 and SAGE II V6.00 of 4 - 12% through 
most of the stratosphere, with large differences (>15%) in the tropical lower stratosphere 
(below 22 km). The RMS statistic shows little improvement when compared with that 
generated by previous versions of the two data sets. The bias statistic shows generally 
small biases (< 1%) through most of the stratosphere, but large biases (> 10% with 
HALOE low compared to SAGE II) persisting in the tropical, subtropical, and lower mid- 
latitude lower stratosphere (below 22 km and between 40°S and 40°N). These results 
represent improvement over previous versions of the data, particularly in the lower 
stratosphere between 40° and 60° in each hemisphere and in the mid to upper stratosphere 
in the tropics and midlatitudes, where earlier versions show the existence of a bias be- 
tween the two data sets. Finally, we see virtually no drift of HALOE V19 ozone observa- 
tions relative to SAGE II V6.00. The results with SAGE V6.00 represent a significant 
improvement over previous versions of the data, particularly in the lower stratosphere 
where drifts of 2 - 5%/year are found relative to HALOE. The modifications to the 
SAGE II retrieval algorithm for V6.00 appear to have eliminated the previously problem- 
atic drift in the lower stratosphere. Should SAGE II fail before the launch of SAGE III, 



our results suggest that HALOE could provide a reliable data bridge between the two 
SAGE data sets. 


Where available, results from previous studies are compared to our TM statistics 
and show generally good agreement, confirming the integrity of the TM technique. TM 
results are not sensitive to the choice of meteorological wind field analysis, as demon- 


strated by the similar results generated using UKMO and NCEP wind fields for the same 
time period. Finally, for trend calculations we continue to recommend use of the Wang 
and Cunnold criteria [SPA/?C, 1998] for filtering of the SAGE II ozone data in the lower 
stratosphere due to contamination by Pinatubo aerosols. 
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Figure Captions 

Figure 1 . Trajectory calculation time as a function of latitude averaged over the nine 
levels in the study. The error bars represent one standard deviation as established by the 
variance in the trajectory length with altitude. These results are for the 8-year (December 
1991 - October 1999) trajectory mapping intercomparison of HALOE and SAGE II 
ozone observations. 

Figure 2. Zonal mean root-mean-square (RMS) differences (see text for definition) be- 
tween HALOE and SAGE II ozone observations as computed from an 8-year, 6-month 
intercomparison (December 1991 — October 1999) using trajectory mapping, (a) HALOE 
V19 and SAGE V6.00. (b) HALOE V6.00 and SAGE V5.93. Large differences (>15%) 
are observed below 22 km with smaller differences in the middle stratosphere. An reduc- 
tion in the RMS statistic appears in (a) relative to (b) in the middle stratosphere, northern 
subtropics. 

Figure 3. Trajectory mapping results of the zonal mean bias statistic (see text for defini- 
tion) for ozone observations of HALOE relative to SAGE II for the same study period as 
in Figure 2. The regions bounded by the dash-dot lines and containing stripes of vertical 
stars (*) are regions not statistically significantly different from 0%, as defined in the 
text, (a) HALOE VI 9 and SAGE II V6.00. (b) HALOE V18 and SAGE II V5.93. We 
see biases of 4 - 20% of HALOE low compared to SAGE II below 22 km in the tropics 
and subtropics. Throughout most of the remainder of the stratosphere, only small differ- 
ences are observed. 

Figure 4. Trajectory mapping results of the drift in the ozone bias (see text for defini- 
tion) of HALOE relative to SAGE II expressed in percent per year. The regions bounded 
by the dash-dot lines and containing stripes of vertical stars (*) are regions not statisti- 
cally significantly different from 0%, as defined in the text, (a) HALOE VI 9 and SAGE 
II V6.00. (b) HALOE VI 8 and SAGE II V5.93. We find only small drifts of HALOE 
relative to SAGE II throughout the stratosphere in the latest versions of the retrievals (a). 
The previous retrievals (b) showed some drift of HALOE increasing relative to SAGE II 
in the lower stratosphere, a region where HALOE appeared biased low compared to 
SAGE II, as shown in Figure 3b. 
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Figure 5. A scatter plot of the bias of HALOE relative to SAGE II tas defined in the 
text) as a function of time. The solid line represents the line of best fit. The slope of this 
line represents the drift statistic. The data for this plot come from trajectory mapping 
done on the 600 K potential temperature surface in the bin from 32° to 36°S. 

Table 1 . The latitude boundaries used to compute the zonal means of the statistics pre- 
sented in the figures of this paper. 


74° - 68°S 

64° - 72°N 

68° - 64°S 

64° - 68°N 

64° - 60°S 

60° - 64°N 

60° - 56°S 

56°- 60°N 

56° - 52°S 

52° - 56°N 

52° — 48°S 

48° - 52°N 

48° - 44°S 

44° - 48°N 

44° - 40°S 

40° - 44°N 

36° - 40°S 

36° - 40°N 

32° - 36°S 

32° - 36°N 

24° - 32°S 

24° - 32°N 

8° - 24°S 

8° - 24°N 


8°S - 8°N 
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NASA Public Summary 


A comparison of HALOE V19 with SAGE II V6.00 ozone observations 
using trajectory mapping 

Gary A. Morris, 1,2 James F. Gleason, 3 James M. Russell, III 4 , 

Mark R. Schoeberl 3 , and M. Patrick McCormick 4 

This study presents the most extensive comparison to date of the ozone profile data sets 
from the Halogen Occultation Experiment (HALOE) aboard the Upper Atmosphere 
Research Satellite (UARS) and from the Stratospheric Aerosol and Gas Experiment II 
(SAGE II) aboard the Earth Radiation Budget Satellite (ERBS). Due to the different 
satellite orbits, the number of coincident measurements available for ozone profile 
comparison is quite small. We combined meteorological data with the satellite ozone 
profile measurements to increase the number of coincident measurements available for 
analysis. Our study shows good agreement between the two data sets throughout the 
stratosphere with the exception of tropical lower stratosphere (15-22 km), where 
HALOE is significantly lower (by 10% or more) than SAGE II. The differences between 
the two data sets remain nearly constant with time over our study period (December 1991 
- October 1999), which lends credibility to ozone profile trend calculations performed 
with either data set. Our results suggest that profile trends calculated from SAGE fl 
V6.00 ozone or HALOE V19 ozone are not due to changes in instrument performance, 
but rather more likely due to real atmospheric changes. 
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